Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

K8s Lib Injection tests run on a matrix #8110

Merged
merged 1 commit into from
Dec 19, 2024
Merged

K8s Lib Injection tests run on a matrix #8110

merged 1 commit into from
Dec 19, 2024

Conversation

robertomonteromiguel
Copy link
Contributor

What Does This Do

This PR run the K8s Lib injection tests on a matrix.

Motivation

This change is necessary because we are going to change the "one pipeline" and these changes could break dd-trace-js pipeline. We need to merge this PR before merging the "one pipeline".
it is the first PR to do this adaptation step by step.

Additional Notes

Coming PRs to apply the change:

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@robertomonteromiguel robertomonteromiguel requested a review from a team as a code owner December 18, 2024 16:04
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 18, 2024 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@pr-commenter
Copy link

pr-commenter bot commented Dec 18, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master robertomonteromiguel/k8s_test_on_matrix
git_commit_date 1734517793 1734537585
git_commit_sha a19f73a 7cb7e72
release_version 1.45.0-SNAPSHOT~a19f73a5ea 1.45.0-SNAPSHOT~7cb7e727ab
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734539928 1734539928
ci_job_id 744127027 744127027
ci_pipeline_id 51463965 51463965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.097 s) : 0, 1097074
Total [baseline] (8.676 s) : 0, 8676394
Agent [candidate] (1.093 s) : 0, 1093009
Total [candidate] (8.634 s) : 0, 8634472
section iast
Agent [baseline] (1.229 s) : 0, 1228920
Total [baseline] (9.257 s) : 0, 9256643
Agent [candidate] (1.232 s) : 0, 1232192
Total [candidate] (9.301 s) : 0, 9300838
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.231 s) : 0, 1231395
Total [baseline] (9.226 s) : 0, 9226109
Agent [candidate] (1.226 s) : 0, 1226340
Total [candidate] (9.167 s) : 0, 9167451
section iast_TELEMETRY_OFF
Agent [baseline] (1.218 s) : 0, 1218053
Total [baseline] (9.189 s) : 0, 9189230
Agent [candidate] (1.224 s) : 0, 1223953
Total [candidate] (9.237 s) : 0, 9237081
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.097 s -
Agent iast 1.229 s 131.847 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.231 s 134.321 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.218 s 120.98 ms (11.0%)
Total tracing 8.676 s -
Total iast 9.257 s 580.249 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.226 s 549.715 ms (6.3%)
Total iast_TELEMETRY_OFF 9.189 s 512.836 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent iast 1.232 s 139.183 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.226 s 133.331 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.224 s 130.944 ms (12.0%)
Total tracing 8.634 s -
Total iast 9.301 s 666.366 ms (7.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.167 s 532.979 ms (6.2%)
Total iast_TELEMETRY_OFF 9.237 s 602.609 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (699.27 ms) : 0, 699270
BytebuddyAgent [candidate] (696.651 ms) : 0, 696651
GlobalTracer [baseline] (319.266 ms) : 0, 319266
GlobalTracer [candidate] (318.38 ms) : 0, 318380
AppSec [baseline] (54.153 ms) : 0, 54153
AppSec [candidate] (54.342 ms) : 0, 54342
Remote Config [baseline] (677.706 µs) : 0, 678
Remote Config [candidate] (662.666 µs) : 0, 663
Telemetry [baseline] (9.92 ms) : 0, 9920
Telemetry [candidate] (9.221 ms) : 0, 9221
section iast
BytebuddyAgent [baseline] (819.826 ms) : 0, 819826
BytebuddyAgent [candidate] (821.628 ms) : 0, 821628
GlobalTracer [baseline] (307.69 ms) : 0, 307690
GlobalTracer [candidate] (308.926 ms) : 0, 308926
AppSec [baseline] (56.817 ms) : 0, 56817
AppSec [candidate] (58.217 ms) : 0, 58217
IAST [baseline] (22.642 ms) : 0, 22642
IAST [candidate] (21.335 ms) : 0, 21335
Remote Config [baseline] (616.414 µs) : 0, 616
Remote Config [candidate] (670.056 µs) : 0, 670
Telemetry [baseline] (7.492 ms) : 0, 7492
Telemetry [candidate] (7.544 ms) : 0, 7544
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (820.04 ms) : 0, 820040
BytebuddyAgent [candidate] (816.602 ms) : 0, 816602
GlobalTracer [baseline] (309.649 ms) : 0, 309649
GlobalTracer [candidate] (307.921 ms) : 0, 307921
AppSec [baseline] (57.546 ms) : 0, 57546
AppSec [candidate] (57.664 ms) : 0, 57664
IAST [baseline] (22.178 ms) : 0, 22178
IAST [candidate] (22.191 ms) : 0, 22191
Remote Config [baseline] (618.385 µs) : 0, 618
Remote Config [candidate] (627.383 µs) : 0, 627
Telemetry [baseline] (7.562 ms) : 0, 7562
Telemetry [candidate] (7.538 ms) : 0, 7538
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (811.778 ms) : 0, 811778
BytebuddyAgent [candidate] (816.446 ms) : 0, 816446
GlobalTracer [baseline] (306.749 ms) : 0, 306749
GlobalTracer [candidate] (306.949 ms) : 0, 306949
AppSec [baseline] (57.527 ms) : 0, 57527
AppSec [candidate] (57.846 ms) : 0, 57846
IAST [baseline] (20.329 ms) : 0, 20329
IAST [candidate] (20.79 ms) : 0, 20790
Remote Config [baseline] (608.459 µs) : 0, 608
Remote Config [candidate] (620.455 µs) : 0, 620
Telemetry [baseline] (7.309 ms) : 0, 7309
Telemetry [candidate] (7.478 ms) : 0, 7478
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1095214
Total [baseline] (10.434 s) : 0, 10433563
Agent [candidate] (1.096 s) : 0, 1095555
Total [candidate] (10.492 s) : 0, 10491720
section appsec
Agent [baseline] (1.233 s) : 0, 1232897
Total [baseline] (10.752 s) : 0, 10752392
Agent [candidate] (1.241 s) : 0, 1241037
Total [candidate] (10.819 s) : 0, 10818892
section iast
Agent [baseline] (1.228 s) : 0, 1227993
Total [baseline] (11.07 s) : 0, 11069569
Agent [candidate] (1.223 s) : 0, 1222916
Total [candidate] (10.97 s) : 0, 10969501
section profiling
Agent [baseline] (1.325 s) : 0, 1324910
Total [baseline] (10.872 s) : 0, 10871716
Agent [candidate] (1.328 s) : 0, 1328165
Total [candidate] (10.829 s) : 0, 10828629
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.095 s -
Agent appsec 1.233 s 137.683 ms (12.6%)
Agent iast 1.228 s 132.779 ms (12.1%)
Agent profiling 1.325 s 229.696 ms (21.0%)
Total tracing 10.434 s -
Total appsec 10.752 s 318.829 ms (3.1%)
Total iast 11.07 s 636.006 ms (6.1%)
Total profiling 10.872 s 438.153 ms (4.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent appsec 1.241 s 145.482 ms (13.3%)
Agent iast 1.223 s 127.362 ms (11.6%)
Agent profiling 1.328 s 232.61 ms (21.2%)
Total tracing 10.492 s -
Total appsec 10.819 s 327.173 ms (3.1%)
Total iast 10.97 s 477.781 ms (4.6%)
Total profiling 10.829 s 336.91 ms (3.2%) 
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.085 ms) : 0, 696085
BytebuddyAgent [candidate] (698.091 ms) : 0, 698091
GlobalTracer [baseline] (319.923 ms) : 0, 319923
GlobalTracer [candidate] (319.095 ms) : 0, 319095
AppSec [baseline] (54.748 ms) : 0, 54748
AppSec [candidate] (54.763 ms) : 0, 54763
Remote Config [baseline] (663.105 µs) : 0, 663
Remote Config [candidate] (668.765 µs) : 0, 669
Telemetry [baseline] (10.038 ms) : 0, 10038
Telemetry [candidate] (9.196 ms) : 0, 9196
section appsec
BytebuddyAgent [baseline] (717.358 ms) : 0, 717358
BytebuddyAgent [candidate] (721.286 ms) : 0, 721286
GlobalTracer [baseline] (316.4 ms) : 0, 316400
GlobalTracer [candidate] (318.297 ms) : 0, 318297
AppSec [baseline] (167.745 ms) : 0, 167745
AppSec [candidate] (169.277 ms) : 0, 169277
Remote Config [baseline] (657.158 µs) : 0, 657
Remote Config [candidate] (662.897 µs) : 0, 663
Telemetry [baseline] (7.414 ms) : 0, 7414
Telemetry [candidate] (7.49 ms) : 0, 7490
IAST [baseline] (19.041 ms) : 0, 19041
IAST [candidate] (20.269 ms) : 0, 20269
section iast
BytebuddyAgent [baseline] (818.171 ms) : 0, 818171
BytebuddyAgent [candidate] (814.282 ms) : 0, 814282
GlobalTracer [baseline] (308.221 ms) : 0, 308221
GlobalTracer [candidate] (307.407 ms) : 0, 307407
AppSec [baseline] (58.132 ms) : 0, 58132
AppSec [candidate] (57.906 ms) : 0, 57906
Remote Config [baseline] (624.989 µs) : 0, 625
Remote Config [candidate] (619.672 µs) : 0, 620
Telemetry [baseline] (7.544 ms) : 0, 7544
Telemetry [candidate] (7.588 ms) : 0, 7588
IAST [baseline] (21.341 ms) : 0, 21341
IAST [candidate] (21.348 ms) : 0, 21348
section profiling
BytebuddyAgent [baseline] (694.574 ms) : 0, 694574
BytebuddyAgent [candidate] (694.954 ms) : 0, 694954
GlobalTracer [baseline] (434.841 ms) : 0, 434841
GlobalTracer [candidate] (435.915 ms) : 0, 435915
AppSec [baseline] (53.437 ms) : 0, 53437
AppSec [candidate] (54.189 ms) : 0, 54189
Remote Config [baseline] (663.284 µs) : 0, 663
Remote Config [candidate] (667.602 µs) : 0, 668
Telemetry [baseline] (7.768 ms) : 0, 7768
Telemetry [candidate] (7.824 ms) : 0, 7824
ProfilingAgent [baseline] (94.062 ms) : 0, 94062
ProfilingAgent [candidate] (95.105 ms) : 0, 95105
Profiling [baseline] (94.085 ms) : 0, 94085
Profiling [candidate] (95.13 ms) : 0, 95130
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-12-18T16:10:54 2024-12-18T16:17:50
git_branch master robertomonteromiguel/k8s_test_on_matrix
git_commit_date 1734517793 1734537585
git_commit_sha a19f73a 7cb7e72
release_version 1.45.0-SNAPSHOT~a19f73a5ea 1.45.0-SNAPSHOT~7cb7e727ab
start_time 2024-12-18T16:10:40 2024-12-18T16:17:36
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734539022 1734539022
ci_job_id 744127028 744127028
ci_pipeline_id 51463965 51463965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1329, 1370
.   : milestone, 1349,
appsec (1.751 ms) : 1727, 1775
.   : milestone, 1751,
appsec_no_iast (1.745 ms) : 1721, 1770
.   : milestone, 1745,
iast (1.486 ms) : 1464, 1509
.   : milestone, 1486,
profiling (1.506 ms) : 1482, 1529
.   : milestone, 1506,
tracing (1.491 ms) : 1465, 1517
.   : milestone, 1491,
section candidate
no_agent (1.356 ms) : 1336, 1376
.   : milestone, 1356,
appsec (1.757 ms) : 1734, 1781
.   : milestone, 1757,
appsec_no_iast (1.736 ms) : 1710, 1761
.   : milestone, 1736,
iast (1.504 ms) : 1482, 1526
.   : milestone, 1504,
profiling (1.506 ms) : 1482, 1529
.   : milestone, 1506,
tracing (1.481 ms) : 1456, 1506
.   : milestone, 1481,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.329 ms, 1.37 ms] -
appsec 1.751 ms [1.727 ms, 1.775 ms] 401.989 µs (29.8%)
appsec_no_iast 1.745 ms [1.721 ms, 1.77 ms] 396.417 µs (29.4%)
iast 1.486 ms [1.464 ms, 1.509 ms] 137.234 µs (10.2%)
profiling 1.506 ms [1.482 ms, 1.529 ms] 156.601 µs (11.6%)
tracing 1.491 ms [1.465 ms, 1.517 ms] 142.073 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.336 ms, 1.376 ms] -
appsec 1.757 ms [1.734 ms, 1.781 ms] 401.205 µs (29.6%)
appsec_no_iast 1.736 ms [1.71 ms, 1.761 ms] 379.28 µs (28.0%)
iast 1.504 ms [1.482 ms, 1.526 ms] 147.555 µs (10.9%)
profiling 1.506 ms [1.482 ms, 1.529 ms] 149.558 µs (11.0%)
tracing 1.481 ms [1.456 ms, 1.506 ms] 124.607 µs (9.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.134 µs) : 353, 393
.   : milestone, 373,
iast (489.103 µs) : 468, 511
.   : milestone, 489,
iast_FULL (647.911 µs) : 626, 669
.   : milestone, 648,
iast_GLOBAL (511.228 µs) : 490, 533
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (493.362 µs) : 472, 515
.   : milestone, 493,
iast_INACTIVE (446.529 µs) : 426, 467
.   : milestone, 447,
iast_TELEMETRY_OFF (478.519 µs) : 456, 501
.   : milestone, 479,
tracing (449.43 µs) : 428, 471
.   : milestone, 449,
section candidate
no_agent (375.057 µs) : 355, 396
.   : milestone, 375,
iast (490.816 µs) : 469, 513
.   : milestone, 491,
iast_FULL (647.251 µs) : 626, 669
.   : milestone, 647,
iast_GLOBAL (526.493 µs) : 504, 549
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (495.682 µs) : 473, 518
.   : milestone, 496,
iast_INACTIVE (445.78 µs) : 425, 466
.   : milestone, 446,
iast_TELEMETRY_OFF (484.399 µs) : 463, 506
.   : milestone, 484,
tracing (441.952 µs) : 422, 462
.   : milestone, 442,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.134 µs [353.322 µs, 392.945 µs] -
iast 489.103 µs [467.604 µs, 510.603 µs] 115.97 µs (31.1%)
iast_FULL 647.911 µs [626.44 µs, 669.382 µs] 274.777 µs (73.6%)
iast_GLOBAL 511.228 µs [489.804 µs, 532.653 µs] 138.095 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED 493.362 µs [471.535 µs, 515.188 µs] 120.228 µs (32.2%)
iast_INACTIVE 446.529 µs [425.735 µs, 467.323 µs] 73.395 µs (19.7%)
iast_TELEMETRY_OFF 478.519 µs [456.343 µs, 500.695 µs] 105.386 µs (28.2%)
tracing 449.43 µs [427.844 µs, 471.015 µs] 76.296 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.057 µs [354.576 µs, 395.538 µs] -
iast 490.816 µs [468.734 µs, 512.897 µs] 115.759 µs (30.9%)
iast_FULL 647.251 µs [625.663 µs, 668.84 µs] 272.195 µs (72.6%)
iast_GLOBAL 526.493 µs [503.587 µs, 549.399 µs] 151.436 µs (40.4%)
iast_HARDCODED_SECRET_DISABLED 495.682 µs [473.5 µs, 517.865 µs] 120.626 µs (32.2%)
iast_INACTIVE 445.78 µs [425.118 µs, 466.441 µs] 70.723 µs (18.9%)
iast_TELEMETRY_OFF 484.399 µs [462.599 µs, 506.198 µs] 109.342 µs (29.2%)
tracing 441.952 µs [421.595 µs, 462.31 µs] 66.896 µs (17.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master robertomonteromiguel/k8s_test_on_matrix
git_commit_date 1734517793 1734537585
git_commit_sha a19f73a 7cb7e72
release_version 1.45.0-SNAPSHOT~a19f73a5ea 1.45.0-SNAPSHOT~7cb7e727ab
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1734539593 1734539593
ci_job_id 744127029 744127029
ci_pipeline_id 51463965 51463965
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.498 s) : 15498000, 15498000
.   : milestone, 15498000,
appsec (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
iast (18.719 s) : 18719000, 18719000
.   : milestone, 18719000,
iast_GLOBAL (17.7 s) : 17700000, 17700000
.   : milestone, 17700000,
profiling (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
tracing (15.088 s) : 15088000, 15088000
.   : milestone, 15088000,
section candidate
no_agent (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
appsec (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
iast (18.271 s) : 18271000, 18271000
.   : milestone, 18271000,
iast_GLOBAL (18.161 s) : 18161000, 18161000
.   : milestone, 18161000,
profiling (14.899 s) : 14899000, 14899000
.   : milestone, 14899000,
tracing (14.808 s) : 14808000, 14808000
.   : milestone, 14808000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.498 s [15.498 s, 15.498 s] -
appsec 15.145 s [15.145 s, 15.145 s] -353.0 ms (-2.3%)
iast 18.719 s [18.719 s, 18.719 s] 3.221 s (20.8%)
iast_GLOBAL 17.7 s [17.7 s, 17.7 s] 2.202 s (14.2%)
profiling 15.022 s [15.022 s, 15.022 s] -476.0 ms (-3.1%)
tracing 15.088 s [15.088 s, 15.088 s] -410.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.934 s [14.934 s, 14.934 s] -
appsec 14.834 s [14.834 s, 14.834 s] -100.0 ms (-0.7%)
iast 18.271 s [18.271 s, 18.271 s] 3.337 s (22.3%)
iast_GLOBAL 18.161 s [18.161 s, 18.161 s] 3.227 s (21.6%)
profiling 14.899 s [14.899 s, 14.899 s] -35.0 ms (-0.2%)
tracing 14.808 s [14.808 s, 14.808 s] -126.0 ms (-0.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~7cb7e727ab, baseline=1.45.0-SNAPSHOT~a19f73a5ea
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.361 ms) : 2319, 2403
.   : milestone, 2361,
iast (2.101 ms) : 2047, 2154
.   : milestone, 2101,
iast_GLOBAL (2.144 ms) : 2091, 2197
.   : milestone, 2144,
profiling (1.985 ms) : 1941, 2028
.   : milestone, 1985,
tracing (1.939 ms) : 1899, 1979
.   : milestone, 1939,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.365 ms) : 2323, 2407
.   : milestone, 2365,
iast (2.105 ms) : 2051, 2158
.   : milestone, 2105,
iast_GLOBAL (2.145 ms) : 2091, 2198
.   : milestone, 2145,
profiling (1.974 ms) : 1931, 2016
.   : milestone, 1974,
tracing (1.946 ms) : 1905, 1987
.   : milestone, 1946,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.361 ms [2.319 ms, 2.403 ms] 884.688 µs (59.9%)
iast 2.101 ms [2.047 ms, 2.154 ms] 623.991 µs (42.3%)
iast_GLOBAL 2.144 ms [2.091 ms, 2.197 ms] 667.733 µs (45.2%)
profiling 1.985 ms [1.941 ms, 2.028 ms] 507.913 µs (34.4%)
tracing 1.939 ms [1.899 ms, 1.979 ms] 462.439 µs (31.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.365 ms [2.323 ms, 2.407 ms] 897.392 µs (61.1%)
iast 2.105 ms [2.051 ms, 2.158 ms] 637.06 µs (43.4%)
iast_GLOBAL 2.145 ms [2.091 ms, 2.198 ms] 677.025 µs (46.1%)
profiling 1.974 ms [1.931 ms, 2.016 ms] 505.995 µs (34.5%)
tracing 1.946 ms [1.905 ms, 1.987 ms] 478.17 µs (32.6%)

@robertomonteromiguel robertomonteromiguel added tag: no release notes Changes to exclude from release notes and removed comp: library injection Library Injection labels Dec 18, 2024
@robertomonteromiguel robertomonteromiguel enabled auto-merge (squash) December 18, 2024 21:14
@robertomonteromiguel robertomonteromiguel merged commit 90899e0 into master Dec 19, 2024
153 of 156 checks passed
@robertomonteromiguel robertomonteromiguel deleted the robertomonteromiguel/k8s_test_on_matrix branch December 19, 2024 09:56
@github-actions github-actions bot added this to the 1.45.0 milestone Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mcculls mcculls mcculls approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

@smola smola Awaiting requested review from smola

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.45.0
Development

Successfully merging this pull request may close these issues.
2 participants
@robertomonteromiguel @mcculls